Physical Infrastructure Management System Having an Integrated Cabinet

ABSTRACT

A data center physical infrastructure management system has a cabinet having rack spaces and a sensor. A data communication system transmits signals to a management database. Personal or automated intervention is determined algorithmically by a data processor. A human interface for the data center management system is provided. Removable electronic assets contained in the rack spaces each have an identifier tag. An identifier tag reader is installed on the cabinet body. A door sensor provides a signal responsive to whether a cabinet door is closed, open, locked, or unlocked, Also, a secure contact arrangement has a base terminal formed of electrically conductive material, and first and second electrically conductive elements. A resilient non-conductive element is interposed between the first and second electrically conductive elements, and a compression element compresses the resilient non-conductive element to cause the first and second electrically conductive elements to communicate with one another.

CROSS REFERENCE TO RELATED APPLICATIONS

This application is a continuation of U.S. patent application Ser. No.14/324,525 filed Jul. 7, 2014 which is a divisional of U.S. patentapplication Ser. No. 13/306,606 filed Nov. 29, 2011, which claimspriority to U.S. Provisional Application No. 61/418,189 filed Nov. 30,2010 and entitled “Physical Infrastructure Management System Having AnIntegrated Cabinet”, the subject matter of which is incorporated byreference in its entirety

This application incorporates by reference in its entirety U.S. patentapplication Ser. No. 12/332,900 filed Dec. 11, 2008 and entitled“Physical Infrastructure Management System.”

BACKGROUND

Servers within data centers often process high value information, andmany organizations' revenues depend upon continuous, uninterruptedprocessing of that data. Power metering, IPLM (Intelligent PhysicalLayer Management), environmental control, asset tracking, and securitymeasures reduce unnecessary operational risk, along with its associatedpotential negative impacts to the organization and its customers.

Information technology staff must also determine existing, new andplanned equipment venues quickly and accurately. Such timelydeterminations save operational expense, facilitate uninterruptedcontinuity of business operations, and increase the return on theongoing investment in data centers.

SUMMARY

In accordance with the invention, there is provided a data centerphysical infrastructure capacity management system that is managed by ITpersonnel. The system includes a server cabinet having rack spaces and asensor. A data communication arrangement propagates communicationssignals from the sensor to a management database that receivesinformation from the communications signals, the received informationbeing stored. A data processor determines algorithmically the need forintervention to the data center physical infrastructure, which may takethe folio of changes to the physical infrastructure, and issuance ofalerts to IT personnel. A human interface enables human interaction withthe data center management system.

In one embodiment, the received information corresponds to environmentaldata.

In a further embodiment, the intervention that may be required by thedata processor is determined to be a selectable one of human andautomated intervention.

The intervention determined by said data processor may take theadditional form of changes to the representative underlying data centersystem management database. The human interface, in one embodiment,employs a graphical user interface that displays icons representative ofpredetermined condition states of the data center.

The data processor in an advantageous embodiment of the inventionincludes a computer, and the algorithmic determination of the need forintervention is responsive to any combination of temperature data;humidity data; a sensor address; a device serial number; the adequacy ofa system ground connection; and the number of occupied rack spaces.

In accordance with a further apparatus aspect of the invention, there isprovided a cabinet for holding removable electronic assets. Inaccordance with this aspect of the embodiment, there is provided acabinet body having a plurality of rack spaces, each rack spaceaccommodating one of the removable electronic assets. A plurality ofidentifier tags are attached to respectively associated ones of theremovable electronic assets, and an identifier tag reader that isinstalled on the cabinet body communicates with at least one of theidentifier tags, providing a tag reader electrical signal responsive tothe communication with the at least one of said plurality of identifiertags. A cabinet door is attached to the cabinet body, and a door sensorprovides an electrical signal responsive to closed, open, locked, andunlocked states of the cabinet door.

In one embodiment of this further aspect of the invention, there isfurther provided a data output for providing data responsive to the tagreader electrical signal. A database stores asset information responsiveto the presence of the removable electronic assets in respective ones ofthe rack spaces. The asset information is obtained from the tag readerelectrical signal, which is itself derived from the identifier tagreader.

In a further embodiment, the identifier tag reader is an elongatedantenna element that is affixed to the cabinet body and extends proximalto a plurality of the rack spaces.

In a further embodiment of the invention, the database is maintained ina remote server that can be accessed wirelessly or over the internet.

The cabinet of an embodiment of the invention additionally has anintegrated cabinet hub disposed in the server cabinet for coordinatingrespective data signals from any combination of: a power monitoringarrangement; a physical layer management system; an environmentalcontrol system; an asset tracking system; a grounding monitoring system;and a security system.

In accordance with an advantageous embodiment of the invention, there isprovided a wireless communication arrangement for delivering data fromthe integrated cabinet hub to a physical infrastructure managementsystem. A monitoring arrangement, has a graphical user interface thatdisplays icons representative of predetermined condition states of thecabinet,

In an advantageous embodiment, there is provided an environmental sensorinstalled. on the cabinet door. Also, an electrical contact arrangementhaving a cabinet door portion and a cabinet body portion conductssignals from the environmental sensor that contain environmentalinformation to the cabinet body. Additionally, in some embodiments,there is further provided a credentials monitoring arrangement forcontrolling the state of the cabinet door.

There is additionally provided a secure contact arrangement that has abase terminal formed of electrically conductive material and first andsecond electrically conductive elements. A resilient non-conductiveelement is interposed between the first and second electricallyconductive elements. A compression element applies an axial forcethrough the first electrically conductive element, the resilientnon-conductive element, the second electrically conductive element, andthe base terminal. The applied axial force compresses the resilientnon-conductive element to cause the first and second electricallyconductive elements to communicate electrically with one another.

In an advantageous embodiment there is further provided an electricalcontact monitoring arrangement that determines whether adequate axialforce has been applied by the compression element so as to compress theresilient non-conductive element and thereby cause the first and secondelectrically conductive elements to communicate electrically with oneanother. The electrical contact monitoring arrangement additionallyserves to determine whether adequate axial force has been applied by thecompression element to urge the first and second electrically conductiveelements into electrical communication with the base terminal.Preferably, at least one of said first and second electricallyconductive elements is provided with a resilient contact element forcommunicating electrically with the other of the first and secondelectrically conductive elements.

BRIEF DESCRIPTION OF THE DRAWINGS

Comprehension of the invention is facilitated by reading the followingdetailed description in conjunction with the annexed drawings, in which:

FIG. 1a depicts a physical infrastructure capacity management system &integrated cabinet architecture according to one embodiment of thepresent invention;

FIG. 1b depicts a variant of the system architecture for an integratedcabinet, wherein one of the functional modules also serves as theintelligent cabinet hub;

FIG. 1c depicts yet another variant showing a wireless Ethernet networkuplink to save data center switch ports;

FIG. 2a depicts a graphical representation of a data center layout;

FIG. 2b depicts a magnified excerpt of the data center layout;

FIG. 3a depicts a server installation process, facilitated and enforcedby Physical Infrastructure Management (PIM) software and by theintegrated cabinet;

FIG. 3b sets forth the legends for the PIM software graphical userinterface symbols;

FIG. 4a depicts an integrated cabinet intelligent door arrangementaccording to the invention;

FIG. 4b depicts details of the intelligent door connector and of thetemperature, and optionally humidity, sensor boards;

FIG. 5a depicts a physical structural representation of one embodimentof the integrated cabinet;

FIG. 5b depicts an excerpted portion of FIG. 5a that has been magnifiedto show greater detail;

FIG. 6 depicts a connected series of eight data center integratedcabinets;

FIG. 7 depicts an alternative connection configuration for a series ofeight integrated cabinets;

FIG. 8 depicts a prior art connection of disparate functional modules asimplemented within a physical infrastructure management system;

FIG. 9 is a graphical representation that illustrates resource savingsthat are achieved with the use of a physical infrastructure managementsystem according to the present invention;

FIG. 10 depicts a simplified representation of an integrated cabinetequipped with a ground bond sensor;

FIG. 11a depicts a specific illustrative embodiment of the invention;

FIG. 11b depicts two principal parts of the invention represented inFIG. 11a ; and

FIG. 12 depicts a schematic diagram of a circuit that is included withinthe hub for processing ground bond sensor signals.

DETAILED DESCRIPTION

FIG. 1a depicts a physical infrastructure capacity management system &integrated cabinet architecture according to one embodiment of thepresent invention. It contains top level data center network managementsoftware 110, such as IBM Tivoli, Physical Infrastructure Management(PIM) software 115, and a physical intelligent cabinet (enclosure notshown), the cabinet containing an integrated intelligent cabinet hub 120and a collection of functional modules: A power module which is a blockrepresenting a modular power outlet unit 121; an intelligent physicallayer management module RIND 122, an example of which appears inPanduit's current PViQ product line; an environmental sensors module123, wherein examples of sensed parameters include temperature,humidity, air flow, differential pressure, vibration, and ambient lightlevel, and automated temperature measurements can provide data to PIMsoftware to simplify computational fluid dynamic (CFD) analysis of datacenter facilities; an asset tracking or asset location module 124; acabinet security module 125 for determination of cabinet door positionand lock status, the cabinet security module 125 may also include acredential reader or a security camera link; display and beacon moduleswhich are in a variety of user interface modules 126; and a ground bondsensor and electrostatic discharge (ESD) policy enforcement module 127.

FIG. 1a shows all of these modules 121-127 connected to integratedintelligent cabinet hub 120 through a serial data sub-network 130. Inthis embodiment, the sub-network may employ an RS485 physical topologyor other serial data sub-network, as shown.

While the serial data sub-network 130 preferably resides within a singleintegrated cabinet, designated generally as 135, it may also spanmultiple cabinets (not shown). In this specific illustrative embodimentof the invention, the RS485 subnet includes additional power conductors,for example 12VDC, so that each module can operate from a single powersupply (not shown) contained as part of the hub. The figure implies thepresence of these additional power conductors, but does not show themexplicitly. The multiplicity of sub-network conductors may take the formof multi-conductor cables (not shown), or alternately, a physicalbackplane (not shown) that accepts plug-in functional modules.

The function modules 121-127 communicate with integrated intelligentcabinet hub 120 via a communications link 131. In some embodiments ofthe invention, there is provided an optional redundant communicationslink 132.

Integrated intelligent cabinet hub 120 communicates upward in thediagram through an Ethernet connection 140 to Physical InfrastructureManagement (PIM) software 115. Other connection protocols can be used inthe practice of the invention. PIM software 115 provides dataaggregation, visualization, capacity planning functionality, andissuance of alerts to physical infrastructure issues that canpotentially affect information technology uptime.

Integrated intelligent cabinet hub 120 contains in some embodiments ofthe invention multiple communication ports (not shown) in order to allowdaisy chaining of hubs. This feature reduces the number of data centerswitch ports (not shown) that would be required to support the physicalinfrastructure capacity management system to less than one per cabinet.Ports placed on the front of the cabinet hub may be offset from thefront of the cabinet.

Some embodiments of the present invention comprise PIM software 115 thatuses its functionality to process and consolidate information forfurther use by top-level data center network management software, suchas IBM Tivoli 110, HP OpenView, Microsoft System Center, or the like.

The collection of functional modules 121-127, the integrated intelligentcabinet hub 120, and the physical cabinet (not shown) constituteintegrated cabinet 135. The combination of the integrated cabinetappliances along with PIM software constitutes the physicalinfrastructure capacity management system. As stated, the physicalinfrastructure capacity management system optionally includes top leveldata center network management software 110, which in this specificillustrative embodiment of the invention is IBM Tivoli.

FIG. 1b depicts a variant of the system architecture depicted in FIG. 1a, for an integrated cabinet. Elements of structure that have previouslybeen discussed are similarly designated. In this embodiment, one of thefunctional modules, specifically power module 121, also serves as partof an overall intelligent cabinet huh 150. More specifically, overallintelligent cabinet hub 150 constitutes a cabinet hub and power supplyfunctionality combined within a single appliance. In this embodiment,power module 121 performs the dual roles of a power outlet unit and of ahub. Although the figure shows a specific embodiment wherein powermodule 121 fulfills dual roles, in other embodiments of the invention,any of the other functional modules can incorporate the additional hubfunctionality.

FIG. 1c conveys yet another embodiment of the invention that is providedwith a wireless Ethernet network uplink 155. The use of wirelessEthernet network uplink 155 serves to reduce the number of otherwiserequired data center switch ports (not shown). Elements of structurethat have previously been discussed are similarly designated. Thisfigure also shows an alternate serial data subnet topology, consistingof multiple sections. In addition to the foregoing, the topologyrepresented in this figure reduces the number of otherwise requiredmodule connections, and increases system reliability. Moreover, theparticular subnet topology of this specific illustrative embodiment ofthe invention allows for detachment of intelligent doors (not shown)without affecting the communicability of other functional modules.

The specific illustrative embodiment of FIG. 1c is shown to have thefunction modules combined in respective sections. As shown, modularpower outlet unit 121, intelligent physical layer management module 122,asset location module 124, user interface modules 126, and ground bondsensor and electrostatic discharge (ESD) policy enforcement module 127constitute one section, that is generally designated as section 160.Section 160 communicates with integrated intelligent cabinet hub 120 viaa communications link 161. There is optionally provided in this specificillustrative embodiment of the invention an optional redundantcommunications link 162. Similarly, environmental sensors module 123 andcabinet security module 125 constitute a further section, identified assection 165. Section 165 communicates with integrated intelligentcabinet hub 120 via a communications link 166. There is optionallyprovided in this specific illustrative embodiment of the invention anoptional redundant communications link 167.

The coordination and synergy of the physical infrastructure capacitymanagement system elements as hereinabove described affords thefollowing advantages: 1) the network and sub-network connection topologyachieves a reduction in IT switch port usage; 2) elimination ofredundant power supplies; 3) reduction of module-borne Ethernet ports,associated computing power and memory requirements; 4) requires but asingle PIM software-borne graphical user interface (GUI) in lieu ofmultiple independent software GUIs; 5) supports top-level data centernetwork management software, by providing physical infrastructuremanagement information. The integrated cabinet, together with PIMsoftware, automates physical infrastructure data collection; 6) thesystem supports data center capacity planning; and 7) issuance of alertsrelating to physical infrastructure issues that can potentially affectinformation technology uptime.

In one embodiment of the invention, the PIM system, such as PhysicalInfrastructure Management (PIM) software 115, is combined with anintegrated rack-unit-level RFID tracking system (not specificallydesignated) to enable the PIM system to acquire information quicklyabout the location and type of equipment installed.

FIG. 2a depicts graphically the layout of a data center 200, and FIG. 2brepresents a portion of the layout of data center 200, the portionrepresented in this figure being enlarged to facilitate comprehension ofthese figures. In this embodiment, each of the grid squares, such asgrid square 210, represents a 2 foot by 2 foot square of floor space.Rows of server cabinets appear, most of which manifest the number 00,except for server cabinet icon 215 located at CX120, which shows thenumber 24. In this diagram, these numbers represent the number ofservers contained within each of the cabinets. A row of switch cabinets220 bisects the layout of data center 200, dividing it into a left side230, and a right side 231 that is not shown in FIG. 2 h.

FIG. 3a is a simplified schematic representation of that is useful indescribing a process of installing one or more servers into the datacenter, which is not specifically designated in this figure. Theinstallation is facilitated by, and is performed in conformance with,PIM software (not shown in this figure), and by the integratedintelligent cabinet hub (not shown in this figure). FIG. 3b depicts thelegend for the PIM software graphical user interface symbols. Thefollowing description of the installation in accordance with the systemof the present invention demonstrates a substantial reduction in thetime and effort required to memorize and display moves, additions, orchanges within a data center, as compared with prior art methods theinvolve the manual entry of data into spreadsheet files (not shown).

Referring to FIG. 3a , frame (1) shows a technician 310 inventorying aserver asset 315 with the aid of an asset tag 320. Asset tags that canbe used in the various embodiments of the present invention include barcode and RFID (radio frequency identification) types of labels. By meansof a unique code (not specifically designated) contained within theasset tag, the PIM system will associate the labeled equipment withassociated data including, for example, model and serial numbers,purchase dates, warranty, physical size, nameplate power consumption,location, and other useful information. Technician 310 transports serverasset 315 to an installation site while executing the required procedurefor PIM system tracking of the asset location.

In FIG. 3a frame (2) the PIM system illuminates a beacon icon 327, aswell as a physical beacon 525 (see, FIGS. 5A and 5B) that directstechnician 310 to a targeted physical cabinet 325 to conduct scheduledwork. Physical cabinet 325 is represented in the PIM system graphicalview of data center 200 as server cabinet icon 215, described above.Technician 310 presents an access credential (not shown) to a credentialreader (not shown) mounted on or near physical cabinet 325. In thepractice of this embodiment of the invention, the credential reader isof a known type, and is capable of accepting any of several known typesof identification information, such as a finger print, an access controlidentification card, key fob data, or any other type of credentialinformation. If the PIM software contains a work order (not shown) fortechnician 310 that requires access to physical cabinet 325, the systemunlocks physical cabinet door 326.

At any time, a remotely located PIM workstation makes available thephysical cabinet status from within the data center view. PIM floor planexcerpt 340 appearing to the right of frame (2) provides visualindication of the status of physical cabinet 325 after physical cabinetdoor 326 is unlocked. The visual indication as status is made manifestwith the use of icons that symbolize the following: Door CLOSED (icon342); Door UNLOCKED (icon 343); and Beacon ON (icon 327).

The PIM system at this point recognizes hat 24 servers areinstalled/consumed within cabinet CX120 (i.e., physical cabinet 325,which is represented in PIM floor plan excerpt 340 as server cabineticon 215). Technician 310 is shown to present his or her accesscredential, and door 326 is unlocked.

FIG. 3a frame (3), technician 310 opens physical cabinet door 326 andexecutes the scheduled work, such as the installation of a server (notshown) that is reflected in server asset icon 215, blanking panelinstallation and removal, and patching activities. Such scheduled workmay also include manually scanning all of the installed or removedassets' bar codes or RFID labels with a hand held scanner/reader (notshown) to record new location information. PIM floor plan excerpt 340now shows the following: Door OPEN (icon 345); Door UNLOCKED (icon 343);and Beacon ON (icon 327).

The PIM system at this point recognizes that 24 servers areinstalled/consumed within cabinet CX120. In this frame (3 a), the PIMfloor plan excerpt 340 shows the current count for a cabinet that lacksan integrated RFID asset tracking module.

If physical cabinet 325 contains an integrated RU (rack unit) level RFIDasset tracking module (not shown), the PIM system quickly absorbs theasset and location information, and then stores the corresponding datain the PIM's database (not shown). Frame (3 a) represents this scenario.

After correctly installing the server and executing all of the scheduledwork, technician 310 closes physical cabinet door 326 as shown in FIG.3a frame (4). PIM floor plan excerpt 340 depicts: Door CLOSED (icon342); Door UNLOCKED (icon 343); and Beacon ON (icon 327).

The PIM system at this point recognizes that 24 servers areinstalled/consumed within cabinet CX120. In this diagram, the excerptshows the current count for a cabinet that lacks an integrated RFIDasset tracking module.

FIG. 3a frame (5) illustrates the cabinet status after the system haslocked physical cabinet door 326 and extinguished the beacon. This isrepresented in PIM floor plan excerpt 340, which depicts: 1) Door CLOSED(icon 342); 2) Door LOCKED (icon 344); and 3) Beacon OFF (icon 328).

In one embodiment, the PIM system recognizes that 24 servers areinstalled/consumed within cabinet CX120. In this diagram, the PIM floorplan excerpt 340 shows at server cabinet icon 215 that the current countfor physical cabinet 325 lacks an integrated RFID asset tracking module.If the cabinet indeed lacks an integrated RFID asset tracking module,technician 310 must then upload the new asset location information intothe PIM system manually. This may be accomplished with the data storedinside of a hand-held bar code scanner, a hand held REID reader, or someother portable data medium, generally designated as handheld reader 311(see, frame (5 a)).

FIG. 3a frame (6) represents the PIM's current recognition of 25 serversthat are installed/consumed within cabinet CX120. In addition, the PIMsoftware now displays an updated location tree. Thus, the PIM floor planexcerpt 340 in frame (6) conveys that all such associated views and theunderlying data have been updated. It is to be noted that in accordancewith the embodiment of FIG. 3a , the system arrives at the databasecontent shown in frame (6) from two differing routes, depending upon theasset tracking method. When integrated cabinets having associated RURFID modules are employed, the manual data entry step depicted in frame(5 a) is not required.

FIG. 3b depicts some of the software icons and structural elements thatare employed in the specific illustrative embodiment of the invention.These include: icon 344 designating door locked; icon 343 designatingdoor unlocked; icon 328 designating beacon OFF; icon 327 designatingbeacon ON; icon 342 designating door closed; icon 345 designating dooropen; icon 215 designating the server cabinet; icon 220 designating aswitch cabinet; icon 351 designating power and maximum usage; PIM screen352 designating the PM screen; PIM report 353 designating the PIMreport; and server asset 315 designating the physical tagged asset.

FIG. 4a depicts the integrated cabinet intelligent door system of thepresent invention. Elements of structure that have previously beendiscussed are similarly designated. As shown in this figure, physicalcabinet door 326 is provided with a perforated door panel 410 thatprovides a suitable mounting location for temperature (and optionallyhumidity and pressure) sensors 415. The door mounting location forsensors 415 is advantageously less cluttered with cabling, and providessafety from damage resulting from ongoing appliance relocation withinphysical cabinet 325 (not shown in this figure). In some embodiments ofthe invention, these sensors 415 are part of acontainment/cooling/control system (not shown). In addition,commercially available electronic swing handle door locks with one ormore integrated credential readers, shown as integrated door lock andcredential reader 420, are mounted on physical cabinet door 326 viastandardized panel cutout dimensions (not specifically designated).

The use of physical cabinet door 326 as a venue for electronic devicespresents the challenge of delivering serial data sub-network conductors450 across the junction between physical cabinet 325 and perforated doorpanel 410 of physical cabinet door 326. The door panel may incorporatein some a dual-hinged feature (not shown), that impedes the use of acable loop solution at one of the hinges (not shown). In order toovercome this challenge, a plurality of contacts 455 is disposed at thetop of physical cabinet door 326, which contacts communicateelectrically with contacts (not shown) that are attached to the cabinetbody (not shown in this figure) upon closure of physical cabinet door326. These contacts may, in some embodiments, take the form of aconductor-to-conductor interface (not shown), or of magnetic elements(not shown) that engage when physical cabinet door 326 is closed. Suchan arrangement of magnetic elements effectively forms a correspondingplurality of transformers (not shown), that are suitable for both,signaling and power delivery.

The incorporation of one or more microprocessors 460 (see, FIG. 4b )(i.e., a programmable integrated circuit that runs algorithms) andserial communications (not shown in this figure) within these functionalmodules makes them self-identifying, self-addressing, andself-configurable. For example, a nonvolatile memory (not shown) withinsensors 415 may store information indicative of a device type (e.g.,temperature sensor); and a device address (e.g., a unique code such as aserial number).

In some embodiments of the invention the serial communicationssub-network may also contain a daisy chain line, that is usable todetermine the relative position of each of the module elements. Forexample, PViQ patch panels, available from Panduit Corp., use thismethodology to deduce the relative position of each device. In oneembodiment if the intelligent door temperature sensor of the presentinvention, the relative position information provides the spatialcoordinates for the location of each sensor.

Automated collection of temperature data, especially over time,significantly simplifies and improves computational fluid dynamic (CFD)analysis of the data center facility. In accordance with the invention,the greater distribution of environmental measurement points with thedata being collected continually, replaces the laborious prior artmethod of manual temperature data collection. This provides morethorough, timely, and current information, as well as visibility ofvariations over time. More accurate data increases confidence in thecalculation of the maximum thermal capacity of a data center. Suchincreased confidence more accurately identifies current operationalmargins, as well as the trigger points for build-out of new data centerfacilities, including the provision of data for cooling, power,connectivity, device location, and the amount of space available.

FIG. 4b shows details of a module 457 that bears a serial sub-networkand power connector 455. Module 457 further includes individualsub-network and power circuits contacts 458 for physical cabinet door326. There is additionally shown in this figure a module 459 formed of aprinted circuit board 456 that bears, in this embodiment, temperaturesensors 415 and microprocessor 460. This module 459 additionally isprovided with serial sub-network and power connectors 465 and 466.

FIG. 5a depicts a physical, structural view of one embodiment ofphysical cabinet 325 and physical cabinet door 326. FIG. 5b depicts anexcerpted portion of the embodiment of FIG. 5 a, specifically ofphysical cabinet 325, that has been magnified to show greater detail. Inthese figures, elements of structure that have previously been discussedor that bear analogous correspondence are similarly designated. As shownin these figures, integrated intelligent cabinet hub 120 resides withina space provided at the top of physical cabinet 325, In otherembodiments, however, integrated intelligent cabinet hub 120 isinstalled into one or more of the horizontal or vertical rack unit (RU)slots (not specifically designated).

A first portion of the asset management functional module, specificallyRU-level RFID reader 515, assumes a dual role as integrated intelligentcabinet hub 120. A second portion of the asset management functionalmodule, the RU-level RIM asset tag reader strip 520, mounts verticallyalongside assets deployed inside the cabinet. RU-level RFID asset tagreader strip 520 is shown to be connected in this embodiment to a readercoaxial port 521. The asset tag reader strip facilitates communicationwith tags placed upon the assets, such as intelligent physical layermanagement modules 122, which in some embodiments are PViQ patch panels,available from Panduit Corp., that are installed in the racks. Inaddition, each such PViQ patch panel in this embodiment is provided witha respective asset tag 320.

Physical cabinet door 326, which in this embodiment incorporates aplurality of environmental monitoring and security functions, is shownto be in the open position, within the left portion of FIG. 5a . Acollection of Power Outlet Units (POUs) 536, with associated powermetering functionality, occupy vertical columns on the right and leftsides of the cabinet body. As previously discussed, the opening ofphysical cabinet door 326 will result in the continued illumination ofphysical beacon 525. As above noted, physical beacon 525 is illuminatedconcurrently with the display of beacon icon 327, and since it islocated on the top of the cabinet body in this embodiment of theinvention, it can be illuminated prior to the opening of physicalcabinet door 326 to direct technician 310 (not shown in this figure) tothe particular cabinet (e.g., physical cabinet 325) that requiresservicing.

In this specific illustrative embodiment of the invention, intelligentPhysical Layer Management (IPLM) modules 122, labeled in the figure as“PViQ EMs (or, Expansion Modules),” reside at the uppermost rackpositions in the figure. These modules provide managed patchingfunctionality within physical cabinet 325.

The functional modules each connect to integrated intelligent cabinethub 120 via one or more sections of serial data sub-network 130, aspreviously described. In FIGS. 5 through 8, squares labeled with “R”(generally shown as RS485 connection points 530) correspond to RS485connection points (or another communication connection for the serialdata sub-network). The squares that are labeled with “E” designaterespective Ethernet connection points 535. RU-level RFID asset tagreader strip 520 communicates with reader coaxial port 521 of RU levelRFID reader 515 through a coaxial cable (shown, but not specificallydesignated). The coaxial borne communications include separable RFmessaging, in addition to serial data sub-network messaging.

Referring again to FIG. 5 a, the physical cabinet 325 communicatesthrough an Ethernet channel 540 to a PIM server 545. The depictedEthernet cloud 550 abstracts a collection of switches, routers,structured cabling, and other required network elements, which are notspecifically shown for sake of clarity and to avoid immaterial detail. APIM workstation, database 555, and PIM server 545 constitute otherelements of the physical infrastructure capacity management system. Suchphysical infrastructure is available at a PIM workstation 560.

FIG. 6 depicts a simplified schematic representation of a connectedseries of eight data center integrated cabinets 611, 612, 613, . . .618. The integrated cabinet hub (not specifically designated) containedby first physical data center integrated cabinet 611 connects to theother integrated hubs through the serial data sub-network 625,optionally including, in this specific illustrative embodiment of theinvention, dedicated daisy chain and power conductors as earlierdescribed. The series of eight physical data center integrated cabinet611, 612, 613, . . . 618 then requires just a single power supply 630 tooperate all of the associated management functional modules and hubs,The power supply connection may mate with a power source availablewithin or near first physical data center integrated cabinet 611. It isnoted that the depicted power supply 630 provides operating energy onlyfor the physical infrastructure management functional modules and hubs,and not for the relatively heavy server and switch loads that deriveoperating power from the Power Outlet Units (POUs) 536 shown in FIG. 5a, Those heavy loads require dedicated, often redundant, power feeds (notshown) through the load outlet connectors of Power Outlet Units (POUs)536.

FIG. 7 depicts an alternative connection configuration for a series ofeight physical data center integrated cabinet 611, 612, 613, . . . 618.Elements of structure that have previously been discussed are similarlydesignated. In this case, a dedicated plurality of coaxial connectors710 on the first cabinet connects with each of the other cabinet coaxialconnectors through a coaxial cable, resulting in a “star” connectionscheme. The coaxial-borne communications may again include separable RFmessaging, in addition to serial data sub-network messaging.

The specific illustrative embodiments of the invention shown in FIGS. 6and 7 offer a limited sample of connection topologies. It is to beunderstood that in the practice of the invention, any of theseconnection topologies can be employed, including a combination of theseand other topologies.

In practice, some of the functional modules are connected to theEthernet network directly, bypassing the serial data sub-network. Apracticable embodiment of the integrated cabinet hub bears amultiplicity of Ethernet connection points to accommodate thiscircumstance. In some embodiments, the hub incorporates Ethernet switchfunctionality in support of functional modules equipped with Ethernetcommunication ports. The hub's multiple Ethernet ports reduce therelatively costly cloud-borne (network) Ethernet switch ports to lessthan one per cabinet. FIGS. 5a and 5b show the hub's multiple Ethernetports most explicitly. The Ethernet ports have been omitted in some ofthe figures for the sake of clarity in presenting the preferredembodiments.

FIG. 8 illustrates a prior art connection of disparate functionalmodules (not shown in this figure) as implemented within a physicalinfrastructure management system, and using a disintegrated cabinetconcept. These functional modules include: 1) power metering; 2) IPLM(Intelligent Physical Layer Management); 3) environmental monitoring; 4)asset management; and security.

As shown, FIG. 8 represents the upper portions of eight physicalcabinets 811 . . . 818, without an integrated cabinet hub. There areshown for the eight physical cabinets 811 . . . 818 respectivelyassociated Ethernet connection points that generally are designated 821. . . 828. The Ethernet connection points in this embodiment constitutea portion of respectively associated patch panels 801 . . . 808, thatare suitable for the connection of internal Ethernet patch cords (notshown) between internal functional module appliances (not shown) and anEthernet switch, represented by Ethernet Cloud 550. It is noted thatsuch necessary Ethernet switches may, in respective embodiments of theinvention, reside externally or internally with respect to the eightphysical cabinets 811 . . . 818.

Each of the eight physical cabinets 811 . . . 818 requires separateEthernet ports for power metering, IPLM, environmental monitoring, assetmanagement, and security. All of these except for the power meteringmodules also require dedicated power supplies, since power meteringmodules often derive operating power from the power feeds (not shown)that primarily energize their associated heavy loads. A disintegratedphysical infrastructure management system will require separate servers,illustratively including: a power metering server 830; an IPLM server831; an environmental server 832; an asset management server 833; and asecurity server 834.

In addition, the disintegrated physical infrastructure management systemwill require separate databases, such as databases 840 and 841. In suchembodiments, separate graphical user interfaces (not shown) areavailable through user workstation 560.

FIG. 9 is a graphical illustration of resource savings that are enabledby methods using a physical infrastructure management systemincorporating features described herein. The vertical axis of theillustration shows the physical infrastructure capacity for anenterprise, and the horizontal axis shows time. In this case, thephysical infrastructure capacity is a summary term combining a number offactors such as physical space, thermal capacity, power availability,connectivity, and rack space. The effective physical infrastructurecapacity can be considered as being bounded by the “most limiting” ofthese factors. For example, if there is plenty of space and power forexpansion, but not enough cooling available for expansion, thermalcapacity is the most liming physical infrastructure factor.

A first plot 10 illustrates the measured consumption of physicalinfrastructure resources under a prior art method of determiningcapacity expansion. A second plot 12 illustrates the measuredconsumption of physical infrastructure resources using a methodaccording to the present invention.

A number of horizontal lines are used to indicate the physicalinfrastructure capacity over time. The horizontal lines 14 and 16represent a guardbanded initial amount of physical infrastructurecapacity in a data center. The horizontal lines 18 and 20 indicate aguardbanded amount of physical infrastructure capacity that results fromexpanding the data center. The horizontal lines 22 and 24 represent aguardbanded physical infrastructure capacity that results from buildinga new data center following the expansion. Systems of the presentinvention allow for narrower guardbands, because decisions to expand canbe made at a more appropriate time.

An arrow 26 represents a time at which a decision is made that anexpansion of physical infrastructure capacity will be needed for anexisting system. This decision is made due to the understanding of thephysical infrastructure needs at that time, which under known systems isflawed due to infrequent and inaccurate measurement of current capacity,consumption, and needs. For example, early in the graph of FIG. 9, plot10 has a steeper slope than plot 12, which presents more accurateinformation regarding the consumed physical infrastructure capacity. Inprior art systems, the decision to expand the data center is being madetoo early, and the needed additional capacity appears to be much largerthan the actual needs of the enterprise.

As a result, in this illustrated scenario, under a prior art approach,the data center is expanded too largely, too quickly. Thus,greater-than-necessary resources (capital expenditures, or CAPEX) areused earlier than needed, resulting in the misallocation of the capitalexpenditures.

Similarly, arrow 28 represents a time at which a decision is made that anew data center will be needed under a prior art decision-making system.Once again, under the prior art system, this decision is made too earlyin the life of the enterprise, in comparison to the actual amount ofphysical infrastructure capacity needed, resulting in a capitalexpenditure misallocation. In both cases, the CAPEX savings resultingfrom a more correctly timed decision are indicated on the graph.

In addition to resulting in unnecessary capital expenditures, anincorrect understanding of the environmental data in a data center canresult in operational expenditures that grow at an unnecessarily fastrate. For example, referring again to FIG. 9, the fast growth inapparently used physical infrastructure capacity under the prior artplot 10 may reflect an overcooling scenario, which may have been theresult of faulty temperature readings, which may have been takeninfrequently. As a result, an ongoing operational expenditure (OPEX) tocool the data center to a temperature that is unnecessarily low may haveresulted in a substantial waste of money for the enterprise. Embodimentsof the present invention will lead to proper allocation of operationalexpenses, leading to the OPEX savings indicated in FIG. 9.

Systems according to embodiments of the present invention enableaccurate measurements to be aggregated and presented to a user in theform of actionable information, allowing the user to make resourceplanning decisions more accurately and efficiently. Examples ofdecisions that can be facilitated under the present inventioninclude: 1) Allocation of the proper amount of cooling resources; 2)Allocation of physical space to need the computational and connectivityrequirements of the enterprise; 3) Determining whether to expand anexisting datacenter or to build a new one; 4) The provision of anappropriate amount of power over the life cycle of a datacenter; 5)Identification of the limiting resource in an enterprises' physicalinfrastructure capacity and an understanding of the amount of thatresource that needs to be added (for example, switching capacity may bethe limiting factor, such that more switches should be added but notnecessarily more rack unit (RU) space); and 6) Identification oflocations within a data center that meet requirements for new hardware(such requirements may include connectivity type and speed.

Sensing of grounding and bonding may also be incorporated into someembodiments of the present invention. Grounding and bonding of equipmentand infrastructure within data centers fulfills at least 2 significantneeds: (a) safety of users and maintenance personnel; and (b) increasedreliability of sensitive electronic appliances through mitigation ofelectrostatic discharge potentials carried upon the bodies of users andmaintenance personnel.

While existing ground bond schemes have the capability to fulfill thesesafety and ESD mitigation needs, they offer no method of verifying ormonitoring the electrical connection and bonding of the groundconductors to the Mesh Common Bonding Network (MCBN). As a result, adata center's infrastructure may completely lack the required groundingand bonding, and owners, users, and maintenance personnel may remaincompletely unaware of this status with its associated risks. A systemcapable of monitoring the ground bond status of the infrastructure'sground connections, and capable of notifying appropriate personnel inthe event of a missing or loose connection, therefore offers asignificant security benefit to these stakeholders.

FIG. 10 depicts a simplified representation of physical cabinet 325equipped with a ground bond sensor 1010. Elements of structure that havepreviously been discussed are similarly designated. Physical cabinet 325undergoes ground bonding to mesh common bonding network (MCBN) 1020through ground bond sensor 1010 that, in turn, connects to a dedicatedground bond sensor port 1030 on integrated cabinet hub 120. Integratedintelligent cabinet hub 120, in combination with ground bond sensor1010, verifies the presence of a ground connection to the cabinet, andverifies that the installer (not shown) has bonded the ground connectionto mesh common bonding network (MCBN) 1020.

FIG. 11a depicts a specific illustrative embodiment of the invention ofa ground bond sensor 1010. FIG. 11b illustrates that ground bond sensor1010 consists of two main portions, specifically: 1) A Ground Sensor,for example, a ground terminal lug 1041 with a heavy gauge groundconductor 1043 leading to mesh common bonding network (MCBN) 1020 (notshown in this figure), plus a smaller-gauge ground sense pilot wire 1045leading to the hub's dedicated ground bond sensor port 1030 (not shownin this figure); and 2) A donut or flat-washer shaped Bonding Sensor1050, with an isolated, normally open contact (not shown), and signalwires 1051 that lead to the hub's dedicated ground bond sensor port 1030(not shown in this figure). Bonding Sensor 1050 provides an electricallyisolated contact closure indication that the installer has tightened theground fastener, that it remains snug, and that the fastener's clampingforce exceeds a minimum specified value.

An isolated, normally open contact (not shown) prevents the sensorfunction from easily being defeated by merely tying the appropriategateway sensor port terminals to ground. This form of contact alsoenables connection of multiple signals together, either physically withwire, or logically through electronic processor algorithms.

Ground Bond Sensor arrangement depicted in FIG. 11 a consists of twoone-sided printed circuit boards (PCBs) 1061 and 1062, respectively,separated by a spring element 1065 in the form of a stiff wave washer orO-ring, and sandwiched between two metallic flat washers 1068 and 1069.In this embodiment, metallic washer 1068 is a metallic stepped washerthat is urged toward, and is stopped against, metallic washer 1069 uponthe tightening of fastener 1070, which in this embodiment is a #10-32screw. Fastener 1070 engages threadedly with a threaded hole in (notshown), or nut on (not specifically designated), cabinet surface 1075.

One-sided printed circuit boards (PCBs) 1061 and 1062 are, in thisspecific illustrative embodiment of the invention, somewhat donutshaped. Optional spring contacts mounted to the PCBs, such as springcontact 1073, mate with etched pads (not shown) on the opposite PCB.Alternatively, a simple disc will bridge the two PCBs together uponapplication of sufficient torque to fastener 1070. A plastic cover ring1071 captivates the sensor parts such that the cover ring suffers nocompression during application of torque to the ground fastener. Asecond spring element, a stiff wave washer or O-ring, provides enoughreactive force to preclude contact closure by merely tightening thescrew by hand. This assures that the installer has used a tool to applytorque, or otherwise bond, the connection. The top washer has a steppedgeometry in order to provide a solid stop against the bottom metalwasher during the application of torque to the screw. This limits thecompression of the spring element and the PCB contacts to tolerablelevels. In the case where a simple disc bridges the two PCBs together,the disc thickness limits the compression of the spring element.

Ring terminal 1041, or ground terminal lug, preferably resides directlyadjacent to the grounded cabinet surface 1075, the cabinet surface beingprovided with a conductive pad (not shown) (for example, a copper pad),free of paint or other insulating materials. This stack up maximizes theconduction surface area of the connection between the MCBN and thecabinet chassis. In other embodiments, the field application of thepresent sensor can include a paint-piercing tooth washer, and optionallya tri-lobular screw to cut through paint coated threads, withsatisfactory grounding results. The screw will incorporate, in someembodiments, a binding type head or other locking mechanisms, such asvarious types of lock washers (not shown). There is optionally providedin this embodiment an internal tooth metallic star washer (notspecifically designated) to enhance engagement between ring terminal1041 and cabinet surface 1075.

FIG. 11c illustrates an embodiment of a ground bond sensor 1080integrated with a ground bond wire 1081. This embodiment reduces thenumber of parts to handle during installation. Although not shownexplicitly, the wires that egress the right side of the assembly breakout to their associated hub port and MCBN destinations. The embodimentoptionally incorporates an indicator LED 1083, and a screw captivationfeature (not shown).

It is noted that other bonded ground connections, such as directly atthe MCBN, can also utilize the ground bond sensor. Preferred embodimentsrequire that fastener schemes employ a headed screw or bolt undertensile load, a torqued nut, or a similar application of compressiveforce to the Sensor.

FIG. 12 is a schematic representation of a specific illustrativeembodiment of the invention. This circuitry, which in some embodimentsis included within the hub, processes the ground bond sensor signals.The hub dedicated ground bond sensor port circuit contains a signalreference, shown as the earth ground symbol, representing an equalpotential connection from the hub to: 1) the cabinet chassis ground, bymeans of the hub's chassis mounting fasteners; or 2) the ground wire,taken from an AC power feed to the cabinet; or 3) the MCBN.

The circuitry functions as follows. The ground sense pilot wire connectsthe SLEEVE terminal of connector J11. With the ground lug of FIGS. 11aor 11 b connected to the cabinet chassis, and the sensor cable (groundsense pilot wire) plugged into the hub's dedicated sensor port, signalvoltage at GND_DET1 goes to 0V. Low pass filtering and transientprotection protect this node from noise and other energetic transients.If the cabinet lacks a ground lug, or if the installer has not pluggedthe sensor cable into the hub sensor port (J11), the GND_DET1 signallevel goes to 3.3V. Although redacted for brevity, GND_DET1 connects toa microprocessor input (not shown), such as an input of Microchip partnumber PIC24FJ256GA110-IPE. Programmatic algorithms contained within themicroprocessor memory report the status of this signal upstream to thePIM Server to notify personnel responsible for the data center.

The bonding sensor signal wires connect to the TIP and RING terminals ofJ11. An open contact, signifying UNBONDED sensor status, causes theGND_DET2 signal voltage to remain low. A closed contact, signifyingBONDED sensor status, causes the GND_DET2 signal voltage to go high.Although redacted for brevity, GND_DET2 connects to a microprocessorinput (not shown), such as an input of microchip part numberPIC24FJ256GA110-IPF. Programmatic algorithms contained within themicroprocessor memory report the status of this signal upstream to thePIM Server to notify personnel responsible for the data center.

Note that with a minor change to the hub circuitry, the bond sensor (orintegrated ground bond sensor) could incorporate a visible LED acrossits normally open contacts to visually indicate, at the sensor, a looseor disconnected termination. In this case the identification andremediation of the incorrect connection becomes much less troublesomeand time consuming, especially in large data centers. The capability ofthis system to report automatically ground bond status to the PIMserver, to notify appropriate personnel, also eases maintenance andincreases reliability of the data center's physical infrastructure.

In yet a further embodiment of the ground bond sensor, the hub circuitryincorporates a digital communication stream between the sensor and thehub. In this embodiment, the sensor incorporates an intelligent devicesuch as Microchip PIC10F283 or Maxim/Dallas DS2401X1. These intelligentdevices contain, in some embodiments, a code that uniquely identifieseach sensor, and further includes the capability to memorize datacommunicated through the serial digital communications. A difference inthe information communicated from these sensor devices indicates thestatus of the sensor. In a specific illustrative embodiment of theinvention, the set of states is as follows: 1) No communications=sensornot present or unplugged; 2) 1111 1111=sensor plugged in and bonded; and3) 0101 0101=sensor plugged in and unbounded.

This embodiment carries the further advantage that each sensor canuniquely identify itself when deployed with a plurality of such sensors,within a multi-drop serial data subnetwork.

Some embodiments of the present invention comprise the followingfeatures: a data center physical infrastructure capacity managementsystem including an intelligent/integrated server cabinet provisionedwith a plurality of sensors (at least one sensor) or actuators, a meansof data communication from sensors to one or more datacenter systemmanagement databases, and a datacenter system management database forreceiving communications from the cabinets and for storing the receivedinformation.

The cabinet periodically providing the datacenter system managementdatabase with ongoing environmental data representative of variousongoing states of the data center's physical infrastructure.

The data center physical infrastructure capacity management system alsoincludes data processing means to determine algorithmically human orautomated intervention to the data center's physical infrastructure, theintervention taking the form of: 1) moves, additions, or changes to thephysical infrastructure; 2) moves, additions, or changes to therepresentative underlying datacenter system management database; 3)alerts to IT personnel; and 4) at least one human interface, enablinghuman interaction with the data center management system.

Although the invention has been described in terms of specificembodiments and applications, persons skilled in the art can, in lightof this teaching, generate additional embodiments without exceeding thescope or departing from the spirit of the invention herein described andclaimed. Accordingly, it is to be understood that the drawing anddescription in this disclosure are proffered to facilitate comprehensionof the invention, and should not be construed to limit the scopethereof.

We claim:
 1. A system configured to interface with a top-level networkmanagement software, said system comprising: a server cabinet, saidserver cabinet including an intelligent cabinet hub and a plurality ofmodules, said plurality of modules being connected to said intelligentcabinet hub and including a power module, an intelligent physical layermanagement module, an environmental sensor module, an asset trackingmodule, and a cabinet security module; and a physical infrastructuremanagement (PIM) software, said PIM software receiving cabinet data fromsaid intelligent cabinet hub and interfacing with said top-level networkmanagement software, said cabinet data including data obtained from saidplurality of modules, wherein said PIM software uses said cabinet datato provide a user with data aggregation, data visualization, capacityplanning, and alert notification, and wherein said PIM software isconfigured to communicate said cabinet data to said top-level networkmanagement software by processing and consolidating said cabinet databefore its transmission.
 2. A system of claim 1, wherein each of saidplurality of modules is serially connected to one other said module. 3.The system of claim 1, wherein no more than two of said plurality ofmodules are directly connected to said intelligent cabinet hub.
 4. Thesystem of claim 1, wherein said PIM software receives said cabinet datafrom said intelligent cabinet hub via at least one of a wired and awireless connection.
 5. The system of claim 1, wherein said power moduleis integrated with said intelligent cabinet hub.
 6. The system of claim1, further comprising a second server cabinet, said second servercabinet including a second plurality of modules, said second pluralityof modules being connected to said intelligent cabinet hub.
 7. Thesystem of claim 6, wherein said second plurality of modules includes asecond power module, a second intelligent physical layer managementmodule, a second environmental sensor module, a second asset trackingmodule, and a second cabinet security module.
 8. The system of claim 6,wherein each of said plurality of modules is serially connected to oneother said module, and wherein one of said plurality of modules isserially connected to one of said second plurality of modules.
 9. Thesystem of claim 1, wherein each of said plurality of modules isself-identifying, self-addressing, and self-configurable.